Large-Scale Estimation of Variance and Covariance Components

نویسندگان

  • Chris Fraley
  • Patrick J. Burns
چکیده

This paper concerns matrix computations within algorithms for variance and covariance component estimation. Hemmerle and Hartley [Technometrics, 15 (1973), pp. 819-831 showed how to compute the objective function and its derivatives for maximum likelihood estimation of variance components using matrices with dimensions of the order of the number of coefficients rather than that of the number of observations. Their approach was extended by Corbeil and Searle [Technometrics, 18 (1976), pp. 31-38] for restricted maximum likelihood estimation. A similar reduction in dimension is possible using expectation-maximization (EM) algorithms. In most cases, variance components are assumed to be strictly positive. We advocate the use of a modification that is numerically stable even if variance component estimates are small in magnitude. For problems in which the number of coefficients is large, Fellner [Proc. discusses the use of sparse matrix methods for positive-definite systems in EM algorithms. We show how to compute the likelihood functions and their derivatives via sparse matrix methods for symmetric-indefinite systems, thus making solution of a much wider class of large-scale problems realizable. Results are formulated for the more general case of covariance components whenever possible.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Bayesian Hierarchical Model for Large-Scale Covariance Matrix Estimation

Many bioinformatics problems implicitly depend on estimating large-scale covariance matrix. The traditional approaches tend to give rise to high variance and low accuracy due to "overfitting." We cast the large-scale covariance matrix estimation problem into the Bayesian hierarchical model framework, and introduce dependency between covariance parameters. We demonstrate the advantages of our ap...

متن کامل

On Variance–covariance Components Estimation in Linear Models with Ar(1) Disturbances

Estimation of the autoregressive coefficient % in linear models with firstorder autoregressive disturbances has been broadly studied in the literature. Based on C.R. Rao’s MINQE-theory, Azäıs et al. (1993) gave a new general approach for computing locally optimum estimators of variance-covariance components in models with non-linear structure of the variance-covariance matrix. As a special case...

متن کامل

Least-Squares Variance Component Estimation: Theory and GPS Applications

Data processing in geodetic applications often relies on the least-squares method, for which one needs a proper stochastic model of the observables. Such a realistic covariance matrix allows one first to obtain the best (minimum variance) linear unbiased estimator of the unknown parameters; second, to determine a realistic precision description of the unknowns; and, third, along with the distri...

متن کامل

Jump robust daily covariance estimation by disentangling variance and correlation components

We propose a jump robust positive semidefinite rank-based estimator for the daily covariance matrix using intraday returns. It disentangles covariance estimation into variance and correlation components, allowing to estimate correlations over lower sampling frequencies to account for non-synchronous trading. The efficiency gain of disentangling covariance estimation and the jump robustness of t...

متن کامل

Non-linear shrinkage estimation of large-scale structure covariance

In many astrophysical settings, covariance matrices of large data sets have to be determined empirically from a finite number of mock realizations. The resulting noise degrades inference and precludes it completely if there are fewer realizations than data points. This work applies a recently proposed non-linear shrinkage estimator of covariance to a realistic example from large-scale structure...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:
  • SIAM J. Scientific Computing

دوره 16  شماره 

صفحات  -

تاریخ انتشار 1995